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Purpose: Elevated levels of serum carcinoembryonic antigen (CEA) following a curative resection of colorectal cancer 
(CRC) indicate recurrence; however, the levels of CEA may be elevated above the normal limit without recurrence. The 
aim of this study is to analyze the diagnostic accuracy of elevated serum CEA for predicting recurrence in postoperative 
stage II and stage III CRC patients. 

Methods: A total of 336 stage II and stage III CRC patients who underwent a curative resection between January 2005 and 
October 2009 were enrolled. Sensitivities, specificities, positive predictive values (PPVs), negative predictive values 
(NPVs), likelihood ratios and post-test probabilities of recurrence associated with elevated CEA were analyzed and com- 
pared. 

Results: The median follow-up duration was 45 months (36 to 134 months). Twenty-seven of 189 stage II patients (14.3%) 
and 52 of 147 stage III patients (35.4%) developed recurrence during the follow-up period. Sensitivities, specificities, 
PPVs, and NPVs of elevated CEA were 37.0%, 91.4%, 41.7%, and 89.7%, respectively, in stage II patients and 46.2%, 
90.5%, 72.7%, and 75.4% in stage III patients. Post-test probabilities of recurrence associated with elevated CEA were 
41.8% in stage II patients and 71.9% in stage III patients. 

Conclusion: The predictive performance of the probability of recurrence associated with elevated serum CEA after a cura- 
tive resection in stage II CRC patients is lower than that in stage III CRC patients. 
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INTRODUCTION 

Recurrence after a curative resection of colorectal cancer (CRC) 
occurs in 30-40% of patients. However, resections of limited met- 
astatic disease may result in a potential cure [1]. Therefore, early 
detection of recurrence is of paramount importance to identify 
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patients who may benefit from salvage surgery. Carcinoembry- 
onic antigen (CEA) has been most commonly used as a tumor 
marker to detect early recurrence amenable to curative surgery. In 
spite of its widespread use and cost effectiveness [2], little is 
known about the accuracy and the efficacy of CEA monitoring 
[3-5]. An elevated level of serum CEA following a curative resec- 
tion of the CRC may indicate recurrence; however, the levels of 
CEA may be elevated above the normal limit without recurrence. 
Also, whether the accuracy of CEA monitoring in stage II is com- 
parable to that in stage III is not known. 

The likelihood ratio and the post-test probability have been re- 
cently reported to be superior to the sensitivity and the specificity 
in comparing the accuracy of a test because they are less influ- 
enced by the morbidity rate [6]. Here, we analyze the diagnostic 
accuracy of elevated serum CEA in postoperative stage II and 
stage III CRC patients by using the likelihood ratios and the post- 
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test probabilities, as well as the sensitivities, specificities, positive 
predictive values (PPVs) and negative predictive values (NPVs). 

METHODS 

Patients who underwent a radical resection for CRC between Jan- 
uary 2005 and October 2009 at Chonbuk National University 
Hospital were enrolled. Patients with stage 0, 1 or IV cancer, insuf- 
ficient follow-up (less than three years), abnormal CEA in the first 
measurement after surgery (checked within three months after 
surgery), history of other cancers and/or history of preoperative 
concurrent chemoradiation therapy were excluded. Finally, 336 
patients with stage II (n = 189) or III (n = 147) CRC were included. 

CEA was measured using an immunoassay method (ADIVA 
Centaur XP immunoassay system, Siemen AG, Erlangen, Ger- 
many). CEA elevation was defined as levels above 5 ng/mL. All 
patients underwent routine serum CEA assays and radiologic ex- 
amination for 5 years. CEA levels were assayed with a 3-month 
interval for the first 2 years and every 6 months thereafter. Chest 
computed tomography (CT) and abdomino-pelvic CT were per- 
formed with a 6 -month interval for the first 2 years and every 1 
year thereafter. The diagnosis of a tumor recurrence was con- 
firmed by biopsy and radiologic evidence. We also obtained sen- 
sitivities, specificities, PPVs, and NPVs. 

Determination of elevated CEA and recurrence was done each 
postoperative year (POY): POY was defined as the period within 
1 year after surgery, POY2 as >1 but <2 years, POY3 as >2 but <3 
years, and POY4 as >3 years. The recurrence rate in any given 
year was obtained by calculating the number of recurrences di- 
vided by the number of patients followed for that year. 

The sensitivity was defined as the fraction of all diseased patients 
with a positive test. The specificity was defined as the fraction of 
all healthy patients with a negative test. The likelihood ratio for a 
positive test was defined as the ratio of the fraction of true posi- 
tives to the fraction of false positives (sensitivity/[l-specificity]). 
The likelihood ratio for a negative test was defined as the fraction 
of false negatives to the true negatives ([l-sensitivity]/specifici1y). 

The pretest probability was defined as the probability that a pa- 
tient suffered from recurrence. The post-test probability was de- 
fined as the probability of recurrent disease in a patient with a 

Table 1. Statistical analysis 
Statistical analysis 

Sensitivity = true positive/(true positive + false negative) 
Specificity = true negative/(true negative + false positive) 
Likelihood ratio (test positive) = sensitivity/(1 -specificity) 
Likelihood ratio (test negative) = (1 -sensitivity)/specificity 
Pretest odds = pretest probability/(1 -pretest probability) 
Post-test odds = likelihood ratio x pretest odds 
Post-test probability = post-test odds/(1 + post-test odds) 



certain test result for CEA. Thus, the likelihood ratio positive 
(LR+) is a measurement of the increase in the probability of dis- 
ease according to a certain test result. LR+ >10 and LR- <0.1 were 
considered to be excellent test results (LR+ >10: a positive test is 
ten times more likely to occur in a patient with recurrence; LR- 
<0.1: a false negative test result will occur in less than one out of 
ten patients with a negative test) (Table 1). 

RESULTS 

Patient characteristics 

The median follow-up duration was 45 months (36 to 134 mon- 
ths). Of the 336 patients, 189 (56.3%) were stage II, and 147 
(43.7%) were stage III. There was no difference between the two 
groups, stage II and stage III groups, except for the recurrence rate 
(Table 2). 

Pretest probability 

In the stage II group, recurrence developed in 27 patients (14.3%). 
The yearly recurrence rates of POY1, POY2, POY3, and POY4 
were 4.2% (8/189), 5.5% (10/181), 1.8% (3/171), and 3.6% (6/168) 
respectively. On the other hand, in the stage III group, recurrence 

Table 2. Clinicopathologic findings of patients according to stage 



Variable 


Stage II (n = 1 89) 


Stage III (n = 1 47) 


P-value 


Age (yr) 


60.4 ± 11.1 (33-83) 


60.4 ±10.7 (29-81) 


0.842 


Gender (M/F) 


122/67 


82/65 


0.103 


Location 






0.484 


Colon 


129 


95 




Rectum 


60 


52 




Depth 






<0.001 


T1 


0 


2 




T2 


0 


11 




T3 


185 


127 




T4 


4 


7 




pN stage 






<0.001 


NO 


189 


0 




N1 


0 


102 




N2 


0 


45 




Size (cm) 


5.4 ±2.1 (1.2-13.7) 


4.7 ±1.7 (1.3-9.1) 


0.590 


Preoperative CEA 
(ng/mL) 






0.184 


<5 


141 (74.6) 


100(68.0) 




>5 


48 (25.4) 


47 (32.0) 




Preoperative CEA 
(ng/mL) 


8.8 ± 26 (0.5-301 .9) 


8.1 ±17.5(0.7-169.2) 


0.056 


Recurrence 


27 (14.3) 


52 (35.4) 


<0.001 



Values are presented as mean ± standard deviation (range) or number (%). 
CEA, carcinoembryonic antigen. 
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developed in 52 patients (35.4%). The yearly recurrence rates were 
19.0% (28/147), 13.4% (16/119), 4.9% (5/103), and 3.1% (3/98), 
respectively (Table 3). These rates were regarded as the pretest 
probabilities in this study. 

Sensitivity, specificity, PPV, NPV in stage II and III 

The overall sensitivity specificity PPV, and NPV of the 336 pa- 
tients investigated were 43.0%, 91.1%, 59.6%, and 83.9%, respec- 
tively. In stage II patients, the results were 37.0%, 91.4%, 41.7%, 
and 89.7%, respectively, and in stage III patients, they were 46.2%, 
90.5%, 72.7%, and 75.4% (Table 4). 

Sensitivity, specificity, and LR in stages II and III each year 

In stage II patients with recurrence, CEA elevation was observed 
in 4, 4, 1, and 1 patients in POY1, POY2, POY3, and POY4, re- 
spectively. The yearly sensitivities of elevated CEA for predicting 
recurrence were 50.0%, 40.0%, 33.3%, and 16.7%, respectively. In 
stage II patients without recurrence, CEA was not elevated in 176, 
166, 166, and 160 patients in POY1, POY2, POY3, and POY4, re- 
spectively, and the yearly specificities were 97.3%, 97.1%, 98.8%, 
and 98.8%. Likewise, in stage III patients, the yearly sensitivities 



were 42.3%, 56.3%, 40.0%, and 33.3% in POY1, POY2, POY3, 
and POY4, respectively, and the yearly specificities were 95.8%, 
97.1%, 99.0%, and 100.0%. 

Using sensitivities and specificities, we calculated positive and 
negative LRs. In stage II patients, the positive LRs were 17.9, 13.8, 
27.8 and 13.9 in POY1, POY2, POY3, and POY4, respectively, and 
the negative LRs were 0.5, 0.6, 0.7, and 0.8. In stage III patients, 
the positive and the negative LRs were 10.1, 19.4, and 40.0 (the 
positive LR of POY4 could not be calculated because the denomi- 
nator was 0) and 0.6, 0.5, 0.6, and 0.7 in POY1, POY2, POY3, and 
POY4, respectively. There were no significant differences in sensi- 
tivity specificity and LR between stage II and III (Table 5). 

Post-test probability 

The post-test probabilities with postoperative CEA elevation were 
41.8% and 71.9% in stage II and III patients, respectively. In stage 
II patients, the corresponding post-test probabilities in POY1, 
POY2, POY3, and POY4, respectively, were 44.0%, 44.5%, 33.8%, 
and 34.2% with postoperative CEA elevation and 2.1%, 3.4%, 
1.3%, and 2.9% without postoperative CEA elevation. However,, 
in stage III patients, the corresponding post-test probabilities in 



Table 3. Yearly recurrence rate after surgery according to stage 



Postoperative year 




Total 


1 2 3 


4 


Stage II 8/189 10/181 3/171 
(4.2) (5.5) (1.8) 


6/168 
(3.6) 


27/189 
(14.3) 


Stage III 28/147 16/119 5/103 
(19.0) (13.4) (4.9) 


3/98 
(3.1) 


52/147 
(35.4) 


Values are presented as number (%). 






Table 4. Elevated serum carcinoembryonic antigen for 
sensitivity, specificity, PPV, and NPV based on stage 


recurrence: 


Variable No. Sensitivity (%) Specificity (%) 


PPV (%) 


NPV (%) 


Total 336 43.0 91.1 


59.6 


83.9 


Stage II 189 37.0 91.4 


41.7 


89.7 


Stage III 147 46.2 90.5 


72.7 


75.4 



80 
70 
60 
50 
40 
30 
20 
10 
0 



■ Before CEA measuring 

■ With CEA elevation 
□ With normal CEA 



II 



lni n .„. 



Total P0Y1 P0Y2 P0Y3 P0Y4 
Stage II 



Total P0Y1 P0Y2 P0Y3 P0Y4 
Stage III 



PPV, positive predictive value; NPV, negative predictive value. 
Table 5. Elevated serum CEA for recurrence: sensitivities, specificities and likelihood ratios at each year 



Fig. 1. Elevated serum carcinoembryonic antigen (CEA) for recur- 
rence: probabilities of colorectal cancer recurrence according to post- 
operative serum CEA status (black column, before test; gray column, 
probability when CEA is elevated; and white column, probability 
when CEA is normal). Post-test probability was 41.8% in stage II pa- 
tients and 71.9% in stage III patients. POY, postoperative year. 









POY (stage II) 










POY (stage III) 






Total 


1 


2 


3 


4 


Total 


1 


2 


3 


4 


Sensitivity 3 , % (n) 


37.0 (10/27) 


50.0 (4/8) 


40.0(4/10) 


33.3(1/3) 


16.7 (1/6) 


46.2 (24/52) 


42.3 (12/28) 


56.3(9/16) 


40.0 (2/5) 


33.3(1/3) 


Specificity", % (n) 


91 .4 


97.2 


97.1 


98.8 


98.8 


90.5 


95.8 


97.1 


99.0 


100 




(148/162) 


(176/181) 


(166/171) 


(166/168) 


(160/162) 


(86/95) 


(114/119) 


(100/103) 


(97/98) 


(95/95) 


LR (CEA elevation) 


4.3 


17.9 


13.8 


27.8 


13.9 


4.7 


10.1 


19.4 


40.0 




LR (normal CEA) 


0.7 


0.5 


0.6 


0.7 


0.8 


0.6 


0.6 


0.5 


0.6 


0.7 



CEA, carcinoembryonic antigen; POY, postoperative year; LR, likelihood ratio. 

Sensitivity is calculated as recurrence with tumor marker elevation/recurrence. "Specificity is calculated as no recurrence with normal tumor marker/no recurrence. 
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POY1, POY2, POY3, and POY4, respectively, were 70.3%, 75.0% 
and 67.4% with postoperative CEA elevation and 12.3%, 7.2%, 
3.0%, and 2.2% without postoperative CEA elevation (the post- 
test probability of POY4 with CEA elevation could not be calcu- 
lated because the positive LR of POY4 was not calculated) (Fig. 1). 

DISCUSSION 

Recurrence after a curative resection of CRC occurs in 30-40% of 
patients. However, recent chemotherapeutic agents and new bio- 
logic agents have greatly improved the survival of patients with 
recurrent disease. Furthermore, complete resections of limited re- 
current diseases may result in a cure. Thus, early detection of re- 
current disease after curative surgery is crucial to identify patients 
who may benefit from additional surgery [7]. CEA has been most 
commonly used as a tumor marker to detect early recurrence and 
is regarded as being more effective in detecting early evidence of 
recurrence than any other single entity, such as liver function 
tests, other tumor markers, and computed tomographic scans [8- 
10]. However, few studies have addressed the differences in the 
diagnostic accuracy of CEA elevation in stage II and III cancer 
patients. 

In evidence-based medicine, the LR and the post- test probability 
have been used to assess the value of performing a diagnostic test 
[11] and have been considered to be more reliable than the sensi- 
tivity and the specificity in comparing the accuracy of tests for dif- 
ferences in morbidity and to be a useful measurement of the 
probability of obtaining a positive or negative test result [12-14]. 
In CRC follow-up, annual postoperative recurrence rates vary be- 
tween stages II and III, indicating that the LR and the post-test 
probability are more suitable than the sensitivity and the specific- 
ity as accurate measures for yearly tumor-marker monitoring [15]. 

In the present study, no differences in sensitivity, specificity, PPV, 
and NPV were found between the stage II and III groups. How- 
ever, the post-test probabilities with postoperative CEA elevation 
were found to be different, 41.8% in stage II patients and 71.9% in 
stage III patients. The accuracy of postoperative CEA to detect re- 
currence was lower in stage II patients, which could be due the 
low incidence of recurrence and the high false-positive rate of 
CEA in stage II patients [15]. 

Many studies have reported on the effectiveness of CEA and its 
diagnostic accuracy, but few studies have compared CEA elevation 
according to stage. CEA elevation has been reported to be dimin- 
ished in value as a tumor marker in early stages [16]. However, the 
results were based on preoperative CEA levels according to stage, 
and follow-up patients after surgical treatment were not included. 

Related to the postoperative diagnostic accuracy of CEA eleva- 
tion after surgery, Hara et al. [15,17] also reported results similar 
to those of our study, with post-test probabilities of about 75% in 
stage III and 30% in stage II in the first postoperative year and 
with efficacy drops below 50% after the first year in stage III pa- 
tients, decreasing progressively year by year. In our study, the post- 



test probability was continually maintained at 70% in stage III. 

Our study has a few limitations. Firstly, as a retrospective study, 
clinical factors that could affect the results were not included in 
the analysis as CEA can be elevated by a few benign conditions 
such as smoking, chronic kidney disease, chronic obstructive pul- 
monary disease and liver disease [18]. Secondly, we did not con- 
sider the effect of adjuvant chemotherapy. Thirdly, the diagnostic 
accuracy of a one-time elevation of CEA was evaluated without 
serial follow-up to exclude temporary elevation [19]. Nonetheless, 
the present study showed that in stage III patients, postoperative 
CEA monitoring had a high accuracy for detecting recurrence. 
However, in stage II patients, CEA elevation indicated recurrence 
with around 40% probability, which is not reliable, and clinician 
always expect a high possibility of false positivity. 

In conclusion, the predictive performance of the probability of 
recurrence associated with elevated serum CEA after a curative 
resection in stage II CRC patients is lower than it is in stage III 
colorectal cancer patients. 
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